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' Abstract. Let G be a group endowed with a solution to the conjugacy 

problem and with an algorithm which computes the centralizer in G of 
any element of G. Let H be a subgroup of G. We give some conditions 
on H , under which we provide a solution to the conjugacy problem in 
H . We apply our results to some Artin groups and braid type groups. 
("V^ In particular, we give explicit solutions to the conjugacy problem in the 

, Artin groups of type A n and C n ■ 
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Let G be a group. A solution for the conjugacy problem in G consists 
on an algorithm which, for given a, b G G, determines whether there exists 
c G G such that a = c~ l bc. An explicit solution for the conjugacy problem is 
. a solution for the conjugacy problem that also determines an element c£G 

such that a = c~ 1 bc. Define the centralizer, Cg(o) = C(a), of an element 
a G G as the set of elements in G that commute with a. A solution for the 
membership problem in G is an algorithm that, for a given finitely generated 
. ^ subgroup H < G and a given g G G, decides whether g G H. 

^ ■ Throughout this paper G will denote a group endowed with an explicit 

solution for the conjugacy problem and with an algorithm that, for any 
element a G G, computes a generating set for the centralizer of a in G 
(which we always assume to be finitely generated). 

The present paper concerns the following question: under which condi- 
tions, for a given H < G, we can find an explicit solution to the conjugacy 
problem in H. 

Let H < G be a subgroup. We say that H verifies Condition PC if there 
exists a group K, a subgroup K' of K and an homomorphism <p : G — ► K, 
such that: 

. H = <p- 1 (K'), 

• there is a solution for the membership problem in K, and 

• the subgroup K' is finite. 

l 
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Let H be a subgroup of G that verifies Condition PC. Our goal is to 
compute an explicit solution to the conjugacy problem in H, using the triple 
(K,K',(f)) of the definition. 

Remark that Condition PC is essentially a condition on the group K 
and not on the subgroup H. This condition on K is very restrictive since 
there are few known classes of groups in which we can give a solution to the 
membership problem. It is known that the following classes of groups have 
a solution to the membership problem: 

• finite groups, 

• free groups, 

• abelian groups, 

• recursively presented metabelian groups, 

• finitely generated fully residually free groups. 

The existence of a solution to the conjugacy problem is also closely related 
to the group based cryptographic systems. In [2] and ^Hj are introduced 
some cryptographic systems, called group based cryptographic system, in 
which the encryption security is based on: 

• the complexity of a solution to the conjugacy problem, and 

• the existence of a fast solution to the word problem. 

A subgroup H for which it does not exists a triple that verifies Condition 
PC will assure us that it is not possible to use our approach to attack an H- 
based cryptographic system. Even if we use a subgroup H of G that verifies 
Condition PC to implement a cryptographic system, we still have, in gen- 
eral, some security advantages when comparing to an G-based cryptographic 
system: 

• the same fast solution for the word problem in H as in the group G, 
and 

• a higher complexity of the solution of the conjugacy problem in H. 

In Section 2 we present some examples of groups and subgroups in which 
we can apply or not our theory. Sections 3 contains the main results and 
algorithms regarding the conjugacy problem. Finally, in Section 4, we make 
some brief remarks about the complexity of the algorithms presented in this 
paper. 

2. Applications 

In this section we will give some examples of groups in which we can apply 
our theory. These examples will be subgroups of Artin groups, and other 
groups that admit braid pictures. We start with some definitions. 

Define a Coxeter matrix of rank n as a n x n symmetric matrix, M = 
(rriij), that verifies: ma = 1 for alH = 1, . . . , n, and my 6 {2, 3, . . .}U{oo}, 
for all i, j € {1, . . . ,n}, i ^ j. Let M be a Coxeter matrix. The Coxeter 
graph associated to M is the labelled graph, T, defined as follows. The set 
of vertices of F is {1, . . . , n}. If my = 2 then there is no edge between i and 



3 



TTij j- — 3, then there is a non-labelled edge between i and j , and, finally, 
if rriij > 3 or rriij = oo, then there is an edge between i and j labelled by 



Let G be a group. For a,b £ G and n € N we define the word 
prod n (a,b) 



(ab) 2 if re = 0(mod 2) 

n— 1 

(a6) _ 2 _ a if re = l(mod 2) 



Define the Coxeter group W associated to the Coxeter graph T as the group 
presented by 

a? = l, »€{l,...,n} \ 
prod mi j (sj, sj) = prodm^Sj^i) J , 
i 7^ j and m^,- 7^ 00 / 

where M = (rriij) is the Coxeter matrix of T. Define the Artin group 
associated to V to be the group presented by 



W = W(T) = { 8 lt 82, 



prod mi j (s^ Sj) = prod mj i (sj, Si) 

i 7^ j and rriij 7^ 00 



A = A(T) = ( si,s 2 ,...,s„ 

If the group W(r) is finite, then we say that A(T) is an Artin group 
of spherical type. It is known that the Artin groups of spherical type have 
explicit solutions for the conjugacy problem (see |H, ^0], ^2]) U3j and [2*T]^. 
Moreover, we also know, for each of these groups, algorithms that compute 
a finite generating set for the centralizer of any element of A(T) (see 
So Artin groups of spherical type are examples of groups in which we can 
apply our theory. A complete classification of these groups is given in [5]. 
TVoughout this paper we will denote by /i : A(T) — ► W(r) the canonical 
epimorphism. 

An important example of a finite Coxeter group is the nth symmetric 
group, S n . The group T, n is generated by the simple transpositions Tj = 
(z,i + l), i = l,...,n — 1. The Coxeter relations in E n are defined by 
the (re — 1) X (re — 1) Coxeter matrix M = (niij), where ma = 1 for all 
i = 1, . . . , n — 1, mj_fi j = rna+x = 3 for all i = 1, . . . , re — 2, and rrtj j = 2 
for all i,j = 1, . . . , n — 1, \i — j\ > 2. The corresponding Coxeter graph is 
the graph A„_i pictured in Figure ^ (see [H]). 



12 3 n-2 n-1 

Figure 1. Coxeter graph A n _i 



The Artin group associated to S n is the braid group, B n , on n strands 
defined by Artin in [3]. Artin's presentation for the braid group B n is 



Br. 



<7l, 02, • • • j C n _i 



OjOi 



UiUi+xGi = CTj + l<7i<7i + l (i 



-j\ >2) 
1 n 



2) 
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The braid group B n admits also a geometric interpretation as follows. 
Consider a disc D, and n distinct points Pi, . . . ,P n in the interior of D. A 
braid b is the union of n disjoint paths b±, . . . , b n in the cylinder D x [0, 1] 
such that, for alH = 1, . . . , n, the path b% (the ith strand) goes monotonically 
in t € [0, 1] from (Pj, 0) to some (Pj, 1). We consider braids modulo isotopy, 
that is, two braids are equivalent if we can transform one into the other by 
deforming the strands, but keeping the ends fixed. Then the braid group is 
the group of isotopy classes of braids. 

Note that the canonical epimorphism \x : B n — ► S n is defined by: /i(crj) = 
Tj. Let b G B n . We say that b is a pure braid if fx(b) = 1, or, equivalently, if 
the ith strand goes form (Pj, 0) to (Pj, 1), for all i = 1, . . . , n. 

Example 1: Let n G N, X C {l,...,n}, and S n be the nth symmetric 
group. Define T, n (X) to be the subgroup of w 6 S„ such that, for all iel, 
o;(i) = i. Define B n (X) = u~ 1 (E n (X)). Briefly speaking, the group B n {X) 
is the set of elements in B n that are pure in the xth strand, for all igl. 

Since the group S n is finite, the triple (S n ,S n (X),u) verifies Condition 
PC, hence we can apply our theory to the subgroup B n (X) < B n , and shall 
obtain by this way a solution to the explicit conjugacy problem in B n (X). 
Remark that B n (X) is a finite index subgroup of B n , hence we can also give 
an algorithm to compute a finite generating set of the centralizer of any 
element of B n (X). This example will be used later. 

Example 2: The above construction has an easy extension to all spherical 
type Artin groups as follows. Pick a subgroup K' of W. Then, as W is finite, 
the triple (W,K',fj,) verifies Condition PC, and we can again apply our 
theory to the subgroup fi~ 1 (K') < A. A particular case is the following. Let 
W be a Coxeter group and let A be the corresponding Artin group. We define 
the colored Artin group, CA, as the kernel of the canonical epimorphism « : 
A — ► W. The colored Artin groups of spherical type appear in the theory 
of arrangements of hyperplanes as fundamental groups of complements of 
the so-called Coxeter arrangements (sec 20 ). 

Example 3: The Artin group of type A n _i is the group associated to 
the Coxeter graph pictured in Figure |5J and the Artin group of type B n 
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Figure 2. Coxeter graph A n _i 

has a presentation given by the Coxeter graph pictured in Figure |31 The 
Coxeter group W{A n _\) is isomorphic to the infinite group Z n_1 x S n , so 
the Artin group A(A n -i) is not of spherical type. Let C2 = {±1} denote the 



12 3 n-1 n 



Figure 3. Coxeter graph B n 

cyclic group of order 2. On the other hand, the Coxeter group of type B n 
is isomorphic to the semi-direct product (C^) 71 x T, n which is finite, hence 
A(B n ) is of spherical type. Let {oi, . . . , a n } be the standard generators of 
A(A n -x), and let {b\, . . . ,b n } be the standard generators of A(B n ). Consider 
the homomorphism : A(A n -i) — ► A(B n ) defined by 

$(oj) = bi, i = l,-- - ,n - 1 

$(a„) = b^b^ • • • b 2 x b x ■ ■ ■ b n . 
The homomorphism is injective (see PP) allowing us to see the group 
A(A n ) as a subgroup of A(B n ). 

Define the homomorphism (p : A(B n ) — > Z by ip(b n ) = 1 and <p(bi) = 
for i < n. In Jf5] it is proved that the group A(A n ) is the inverse image of 
{1} by (p. Now, because Z is abelian, hence it is endowed with a solution 
to the membership problem, and {1} is finite, the triple (Z,{l},(/j) verifies 
Conditions PC. So, we can apply our theory to the pair (A(A n -i) , A(B n )) , 
and give an explicit solution to the conjugacy problem in A{A n -\). Another 
solution to the conjugacy problem in A(A n -i) can be derived from the facts 
that A(A n -\) is biautomatic (see (Zj), and that a biautomatic structure 
on a group provides a solution to the conjugacy problem (see The 
centralizers of some specific elements of A(A n _i) are given in [S]. 

Example 4: Let X = {1, ... , m} C {1, ... ,n}, and let nx ■ B n (X) — > 
CB m be the homomorphism which sends a braid b = (bi, . . . , b n ) € B n (X) 
to the pure braid irx(b) = ■ ■ ■ , b m ). It is easily checked that irx is a well- 
defined homomorphism. Define IB n {X) as the kernel of the projection ttx- 
Note that IB n {X) is the braid group on n — m strands of the m punctured 
disc. Presentations for these groups are given in |17j . 

Assume X = {1,2}. Then the Artin group of type C n -i, defined by the 
Coxeter graph pictured in Figure |1J is isomorphic to B n (X) (see JT.). By 

4 4 
• • • •- - - - - -• • 

12 3 n-1 n 

Figure 4. Coxeter graph of C n -\ 

Example 1, we have that the group B n (X) has a solution to the explicit 
conjugacy problem, and we can compute a generating set of the centralizer 
of b for all b £ B n (X). Moreover, the colored braid group CB2 is isomorphic 
to Z, thus the triple (CB2, {!}, itx) verifies Conditions PC, hence we can 
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apply our theory to the subgroup ZB n (X) < B n (X), and obtain a solution 
to the explicit conjugacy problem in A(C n —\). As far as I know, there is no 
other known solution to the conjugacy problem in A(C n -\). 

Beside the finite groups, another family of well-understood Coxeter groups 
are the so-called afhne Coxeter groups which include, notably, the groups of 
type A n and C n . The corresponding Artin groups, called affine type Artin 
groups, are poorly understood. Some other recent results concerning the 
groups A(A n ) and A(C n ) can be founded in and [S]. The previous 
techniques (Examples 1 and 3) give algorithms to treat the cases A n and 
C n , but we do not know how to deal with the other affine type Artin groups. 

Now, we show that it is not possible to apply our theory to the pair 
(IB n (X), B n (X)) for all m > 5. We do not know how to treat the cases 
m = 3 and m = 4. 

Remark: If m = n then TB n (X) is the trivial group, hence we have a 
solution to the conjugacy problem. If m = n — 1 then ZB n (X) = F m (the 
free group on m generators), thus we also have a solution to the conjugacy 
problem in IB n {X). If3<m<n — 2 then we do not know any solution to 
the conjugacy problem in TB n (X). 

Proposition 2.1. Let X = {l,...,m} C {1, . . . ,n}, m > 5. There is 
no triple (K,K',(ft) such that K is a group endowed with a solution to the 
membership problem, K' is a subgroup of K, (ft is a homomorphism (ft : 
B n {X) — > K, and ^{K') = TB n {X). 

Proof. Note that, if such a triple exists, then we can assume that the ho- 
momorphism (ft is surjective. If (ft is not surjective, and (K,K',(ft) verifies 
Condition PC, then the triple (Im ((ft), K' , (ft) also verifies Condition PC 
and, in this case, (ft is surjective. 

Consider the natural embedding i : B m — > B n (X) defined by i(ai) = Oi 
for all % = 1, . . . , m — 1. Then l restricts to a monomorphism t : CB m — > 
B n (X) which, actually, is a section of ttx '■ B n (X) — > CB m . So, we have 
the split exact sequence, 

1 TB n {X)t B n (X) ^ CB m 1 • 

Define the homomorphism tt' x : K — > B m as follows. Let v € K. Take 
v G B n (X) such that (ft(v) = v, and set tt' x (v) = irx(v). Suppose that w 
is another element of B n (X) such that (ft(w) = v. Then (ft(wv~ l ) = 1, thus, 
since 1 G K' , wv^ 1 G <p~ l (K') = ZB n (X), therefore 7rx(uw _1 ) = 1, that 
is, ttx(w) = ttx(v). This shows that the homomorphism n' x is well-defined. 
Remark that, by construction, ir' x o (ft = ttx- 

Now we prove that Kerir' x = K' . Let a G K' . Take a G 2B n (X) such that 
4>(a) = a. So, n x (a) = 7Tx(a) = 1, hence a G Kerir' x . Let a G Keri\' x . Then 
there exists a G B n (X) such that (ft(a) = a. Because vrx(o) = ^x( a ) = 1> 
we have a G lB n (X) and (ft[a) = a G K' . 
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Let 



■ o t. 



and observe that J is a section of 7r' 



At this point, we have proved that the following diagram is commutative 
and that the lines are split exact sequences. 



1 ^TB n {XY B n {X) ; CB.. 



K' 



id 



CB n 



Let F2 be the free group on two generators, and let R = F2 x F%. Theorem 
1 of |18j tells that we can inject R in CB m , if m > 5, and Theorem 1 of ^5] 
says that there is no solution to the membership problem in R. Now, CB m 
can be embedded in K via t' , thus R can be embedded in K, too, so, K has 
no solution to the membership problem. 

□ 



3. The conjugacy algorithm 

In this section we assume that G is a group, H is a subgroup of G, and 
(K, K', (ft) is a triple that verifies Condition PC, and we prove an algorithm 
which solves the explicit conjugacy problem in H. 

We start with a preliminary algorithm. 

Algorithm 3.1. From conjugation in G to conjugation in H 

Let a,b G H, h G G such that b = h~ 1 ah. This algorithm will return 
FALSE, if a and b are not conjugated in H, and TRUE together with an 
element h' G H such that b = (h')~ 1 ah l , otherwise. This algorithm works 
as follows. 

Let a, b G H, and h G G such that b = h~ 1 ah. Recall that the group 
G is endowed with an algorithm that computes a finite generating set D 
of Cc(a). By Condition PC the set (ft(Co(a)h) n K' is finite, and we can 
enumerate all its elements as follows. Observe that ^»(Cg(o)) = {(ft(D)). For 
each k G K', check whether kh^ 1 G 0(Cc?(a)). This can be done because 
we know that 0(Cg(o)) is generated by (ft(D), and because K is endowed 
with a solution to the membership problem. Since K' is finite this process 
will stop. If 0(C(3(a)/i) n K' = 0, then a and b are not conjugated in H. 
Indeed, if b = {h')~ l ah' for some h! G H, then /j'/i -1 G Ca(a), and = 
<ft(tih- l h) G IT, so 0(C G (a)/i)niT ^ 0. Suppose that (ft(C G (a)h)nK' / 0. 
Take an element p G (ft(CG(a)h)nK' and write p = 4>{d\) ■ ■ ■ (ft(d q )(ft(h), where 
d\, . . . , d q G D. Set d = d\ ■ ■ ■ d q , and b! = dh. Then ^(/i') = p £ K' (thus 
ft/ G if), and (/i')~ 1 a/i / = h^d^adh = h~ x ah = b. We can resume this 
algorithm in the following way. 
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INPUT: A group G, a subgroup H of G, a triple (K,K',<fi) that verifies 
Condition PC, two elements a, b G H, an element h G G such that b = 
h~ l ah. 

(1) Compute a generating set D of Cc(a). 

(2) For each p £ K' do: 

(a) If p^/r 1 ) G 0(C G (a)), then do: 

(i) Write p = </>(c£i) • • • 4>(d q )(j)(h), where d\, . . . ,d q G D. 

(ii) return TRUE and h! = d\- ■ ■ d q h. 

(3) return FALSE 

OUTPUT: either FALSE if a and b are not conjugated in H, or TRUE 
together with an element h! G H such that b = h'~ 1 ah', otherwise. 

Algorithm 3.2. Explicit conjugacy algorithm in H 

Given a,b G H C G, apply the known conjugacy algorithm to a and b. If 
a and b are not conjugated as elements in G, then they cannot be conjugated 
in H. Otherwise, take h G G such that h~ 1 ah = b, and apply Algorithm 
3.2. 

INPUT: A group G, a subgroup H of G, a triple (K,K',4>) that verifies 
Condition PC, two elements a,b G H. 

(1) For a,b G H test if they are conjugated in G. If they are not then 
return FALSE. 

(2) Let h G G be the output of the explicit conjugacy algorithm of G. 

(3) Apply Algorithm 3.1 to a, b and 7i and return the output of Algorithm 
3.1 

OUTPUT: either FALSE if a and b are not conjugated in H, or TRUE 
together with an element h! G H such that b = h'~~ 1 ah', otherwise. 

4. Considerations on the complexity of the algorithms 

In general it is not possible to present an upper bound for the complexity 
of the algorithms presented in the previous section. There are several factors 
to take in charge. The first ones are the complexities of the conjugacy 
problem and of the algorithm to compute a generating set of the centralizers 
in G. Theses complexities, in the cases of the Artin groups of spherical 
type, are related to the size of a particular subset of the conjugacy class, the 
number of generators and the length of the word (see JO]) |H] and |13j). 
Regarding the algorithms presented, we have also the following factors, the 
complexity of a solution to the membership problem in K, and the number 
of generators of the centralizers in G. Regarding this last factor we have 
some upper bounds in the case of the braid group (see [H]). 
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